Decomposing Isotonic Regression for Efficiently Solving Large Problems
نویسندگان
چکیده
A new algorithm for isotonic regression is presented based on recursively partitioning the solution space. We develop efficient methods for each partitioning subproblem through an equivalent representation as a network flow problem, and prove that this sequence of partitions converges to the global solution. These network flow problems can further be decomposed in order to solve very large problems. Success of isotonic regression in prediction and our algorithm’s favorable computational properties are demonstrated through simulated examples as large as 2 × 10 variables and 10 constraints.
منابع مشابه
Primal-Dual Active-Set Methods for Isotonic Regression and Trend Filtering
Isotonic regression (IR) is a non-parametric calibration method used in supervised learning. For performing large-scale IR, we propose a primal-dual active-set (PDAS) algorithm which, in contrast to the state-of-the-art Pool Adjacent Violators (PAV) algorithm, can be parallized and is easily warm-started thus well-suited in the online settings. We prove that, like the PAV algorithm, our PDAS al...
متن کاملA segmentation-based algorithm for large-scale partially ordered monotonic regression
Monotonic regression (MR) is an efficient tool used for estimating functions that are monotonic with respect to input variables. We have recently developed a fast high-accuracy approximate algorithm, called GPAV. It allows solving efficiently large-scale multivariate MR problems. We present here an approach which extends the area of its applications to much larger MR problems, in which the orig...
متن کاملA Faster Algorithm Solving a Generalization of Isotonic Median Regression and a Class of Fused Lasso Problems
Many applications in the areas of production, signal processing, economics, bioinformatics, and statistical learning involve a given partial order on certain parameters and a set of noisy observations of the parameters. The goal is to derive estimated values of the parameters that satisfy the partial order that minimize the loss of deviations from the given observed values. A prominent applicat...
متن کاملA Dual Active-Set Algorithm for Regularized Monotonic Regression
Monotonic (isotonic) regression is a powerful tool used for solving a wide range of important applied problems. One of its features, which poses a limitation on its use in some areas, is that it produces a piecewise constant fitted response. For smoothing the fitted response, we introduce a regularization term in the monotonic regression, formulated as a least distance problem with monotonicity...
متن کاملGeneralized continuous isotonic regression
The standard isotonic regression of a vector in IRn is the solution to a least squares projection problem on the cone C of vectors with ‘increasing components’ in IRn. Generalized isotonic regression problems are isotonic optimization problems that seem to be quite different from isotonic regression problems, but in fact have the same solution. In problems of maximum smoothed likelihood estimat...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2010